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Abstract 

The present paper completes our earlier results on nonlinear stabil- 
ity of stationary solutions of the Vlasov-Poisson system in the stellar 
dynamics case. By minimizing the energy under a mass-Casimir con- 
straint we construct a large class of isotropic, spherically symmetric 
steady states and prove their nonlinear stability against general, i. e., 
not necessarily symmetric perturbations. The class is optimal in a 
certain sense, in particular, it includes all polytrones of finite mass 
with decreasing dependence on the particle energy, lil 



-'^This work was published as Guo, Y., Rein, G.: Isotropic steady states in galactic 
dynamics. Commun. Math. Phys. 219, 607-629 (2001). We correct an error in the analysis 
of the limiting "Plummer case" which was pointed out to us by Y.-H. Wan: In the proof of 
the former Lemma 7 we used the "identity" J f*{x,v)dv = {J f{x,v)dv)* where * denotes 
the symmetric decreasing rearrangement with respect to x. This is clearly false, and we 
modify Section 6 accordingly and also a detail in the proof of Theorem 3. 
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1 Introduction 



The question of which galaxies or globular clusters are stable has for many 
years attracted considerable attention in the astrophysics literature, cf. @, || 
and the references there. If one neglects relativistic effects and collisions 
among the stars, then from a mathematics point of view the question is 
which steady states of the Vlasov-Poisson system 

dtf + v-dJ-d,U-dJ = 0, 

AU = A7cp, lim U{t,x) = 0, 

\x\^oo 

p(t,x) = J f{t,x,v)dv, 

are stable. Here f = fit,x,v)>0 denotes the density of the stars in phase 
space, t G IR denotes time, x,v E IR^ denote position and velocity respectively, 
p is the spatial mass density of the stars, and U the gravitational potential 
which the ensemble induces collectively. 

If Uq is a time-independent potential then the particle energy 

E=^\v\' + Uo{x), (1.1) 

is conserved along the characteristics of the Vlasov equation. Therefore, a 
standard technique to obtain steady states of the Vlasov-Poisson system is 
to prescribe the particle distribution /o as a function of the particle energy — 
this takes care of the Vlasov equation — and to solve self-consistently the 
remaining Poisson equation. The main problem then is to show that the 
resulting steady state has finite mass and possibly compact support. A well 
known class of steady states for which this approach works are the so-called 
polytropes 

Ux,v) = iEo-E)1. (1.2) 

Here (■)+ denotes the positive part, i^oGlR is a cut-off energy, and — 1/2< 
k<7/2; only for this range of exponents do these steady states have finite 
mass, if k<7/2 they have compact support in addition. If /q depends only 
on the particle energy the resulting steady state is isotropic and spherically 
symmetric. Assuming spherical symmetry of Uq to begin with steady states 
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may also depend on a further conserved quantity, the modulus of angular 
momentum squared, 



in which case they are no longer isotropic. According to Jeans' Theorem the 
distribution function of any spherically symmetric steady state has to be a 
function of the invariants E and L, cf. 0. 

In ^, |10|, |T7| we addressed the stability of steady states by a varia- 
tional technique: It was shown that an appropriately chosen energy- Casimir 
functional has a minimizer under the constraint that the mass is prescribed, 
this minimizer was shown to be a steady state, and its nonlinear stability 
was derived from its minimizing property. While this turned out to be an 
efficient method to assess the stability of known steady states and also to 
construct new ones which automatically have finite mass, compact support, 
and are stable, there were two unwanted restrictions: Perturbations had to 
be spherically symmetric, and only the polytropes with < < 3/2 were cov- 
ered. A physically realistic perturbation, say by the gravitational pull of 
some distant galaxy, is hardly spherically symmetric. Also, while the restric- 
tion A; > was indispensable — for /c < no corresponding Casimir functional 
can be defined — and is probably necessary for stability since it makes /o a 
decreasing function of the particle energy, the restriction k<3/2 is less well 
motivated. In [|| the first author removed the latter restriction in the case 
of the polytropes, while in |[T^ the second author removed the restriction 
to spherically symmetric perturbations for a class of isotropic steady states 
including the polytropes with k<3/2 . It is the purpose of the present paper 
to combine these techniques to obtain a result which we believe is optimal 
in the following sense: It does not require any symmetry restrictions of the 
perturbations, and it covers all isotropic polytropes. As a matter of fact, the 
restrictions we require of the steady states are necessary to guarantee finite 
mass and to make the distribution function a decreasing function of the en- 
ergy. Presumably, if the latter condition is violated sufficiently strongly, then 
the steady state is unstable. 

The new elements in our analysis which allow for the improvements de- 
scribed above are the following: Previously we minimized an energy- Casimir 
functional under a mass constraint. Now we minimize the total energy of 
the system under a mass-Casimir constraint. The change of the role of the 
Casimir functional — from part of the minimized functional into part of the 
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constraint — allows us to remove the restriction A; < 3/2 and was introduced in 
[|]. It also leads to a much cleaner assumption on the steady state or on the 
Casimir functional respectively. Inspired by the concentration-compactness 
argument due to P. L. Lions [|14|, which was used in |18[, we use a re- 



finement of our previous scaling and splitting argument in the compactness 
analysis of the energy functional to get rid of the symmetry assumption for 
the perturbations. 

The investigation is restricted to isotropic steady states: If one includes 
anisotropic ones then the Casimir functional is not conserved along not spher- 
ically symmetric solutions, and the method breaks down. Anisotropic steady 
states are — under the appropriate assumptions — stable against spherically 
symmetric perturbations. Whether or not they are stable against general 
perturbations remains an open problem. 

The paper proceeds as follows: In the next section we establish some pre- 
liminary estimates which in particular show that the total energy is bounded 
from below and the kinetic energy is bounded along minimizing sequences. 
In Section 3 the existence of a minimizer of the energy is established. To pre- 
vent mass from running off to spatial infinity along a minimizing sequence 
we analyze how the total energy behaves under scaling transformations and 
under splittings of the distribution into different pieces. In Section 4 we 
show that such minimizers are spherically symmetric steady states of the 
Vlasov-Poisson system with finite mass and compact support. The stability 
properties of the steady states are then discussed in the Section 5. Here we 
point out one problem: If /q is a steady state then /o(x + tV,f + V") for any 
given velocity V E IR^ is a solution of the Vlasov-Poisson system which for V 
small starts close to /o, but travels away from /o at a linear rate in t. This 
trivial "instability", which cannot be present for spherically symmetric per- 
turbations, is handled by comparing /o with an appropriate shift in x-space 
of the time dependent perturbed solution f{t). Technically, the necessity of 
this shift arises in the application of our compactness argument. The con- 
siderations discussed so far are restricted to Casimir functionals satisfying 
a growth condition which excludes the polytropic case k = 7/2. This limit- 
ing case, the so-called Plummer sphere, is investigated in the final section. 
It poses additional difficulties due to a particular scaling invariance of the 
various functionals considered, but by using rearrangements we are able to 
reduce it to the same problem with symmetry, which has been investigated 
in M. This shows that is can be essential to understand the symmetric case 
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first, and we hope that such a reduction to symmetry can be apphed to other 
problems as well. 

We conclude the introduction with some references, where we also com- 
pare our approach with other approaches to the stability problem. The first 
nonlinear stability result for the Vlasov-Poisson system in the present stellar 
dynamics case is due to G. Wolansky ||2^. It is restricted to spherically 
symmetric perturbations of the polytropes 

fo{x,v) = {Eo-E)lL' (1.4) 

with exponents / >— 1, 0<A;</ + 3/2 with k^—l — 1/2 and uses a variational 
approach for a reduced functional which is not defined on a set of phase space 
densities / but on a set of mass functions M(r) : = j\y\<r Piv) '^V with r>0 
denoting the radial coordinate. In particular, is does not yield a stability 
estimate directly for the phase space distribution /. In |21[| Y.-H. Wan 
proves stability by a careful investigation of the quadratic and higher order 
terms in a Taylor expansion of the energy- Casimir functional about a steady 
state. He has to assume the existence of the steady state, requires a strong 
condition on /o which is satisfied by the polytropes only for k = l and / = 
0, but his arguments do not require spherical symmetry of the admissible 
perturbations. We also mention [0] where stability for the limiting polytropic 
case k = 7/2 and / = is considered. Global classical solutions to the initial 



value problem for the Vlasov-Poisson system were first established in 



cf. also |2^. A rigorous result on linearized stability is given in 0. For the 



plasma physics case, where the sign in the Poisson equation is reversed, the 
stability problem is better understood; we refer to [|, [IT], [12], |16|. Finally, a 



very general condition which guarantees finite mass and compact support of 
steady states, but not their stability, is established in |T^ . 



2 Preliminaries 

For a measurable function f = f{x,v) we define 

pf{x):= J f{x,v)dv, xGM.^ 

and ^ 

Uf-=-Pf*Tl- 
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Next we define 




[ \\/Uf{x)\^dx 



f{x,v)dvdx 



1 



// 



pf{x)pf{y) 



dxdy, 



Sir J 



2 



x-y 



nif) 



EUf) + EMf), 



and 



C(/):= llQ{f{x,v))dvdx 



where Q is a given function satisfying certain assumptions specified below. 
We will minimize the total energy or Hamiltonian 7i of the system under a 
mass-Casimir constraint, i. e., over the set 



^A/:={/G^'(IR')|/>0, C(/) = M, Ekin(/)<oo}, (2.1) 



where M > is prescribed. The function Q has to satisfy the following 
Assumptions on Q: Q eC^{[0,oo[), Q >0, Q(0) = 0, and 

(Ql) Q{f)>C{f + f^+^/^), />0, with constants C>0 and 0< A; < 7/2, 

(Q2) Q is convex. 

Remark. 

(a) In the last section we consider the limiting case k = 7/2 for which 



(b) On their support the minimizers obtained later will satisfy the relation 



with some Lagrange multiplier Ao<0 and E as defined in ( |1 . 1| ) . Thus 
/o is a function of the particle energy and thus a steady state of the 
Vlasov-Poisson system, provided this identity can be inverted. 



Q(/):=r^ />0. 



XoQ'{fo)=E 
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(c) A typical example of a function Q satisfying the assumptions is 



QU) = f+f 



1+1/.^ />o, 



(2.2) 



with < A; < 7/2 which leads to a steady state of polytropic form (|1.2|) . 
More generally, if an isotropic steady state (/o,t/o) is given with /o of 
the form 



with some function then the above assumptions for the Casimir func- 
tional hold, if 0(-E) vanishes for E larger than some cut-off energy £"0, 



(p{E) < C{Eo - E)^ E < Eo, where 0<k< 7/2, and (j)'{E) <0, E<Ei 



The existence of a cut-off energy is necessary in order that the steady 
state has finite mass. The growth condition is essential for the com- 
pactness properties of H; cf. the difficulties in the limiting case k = 7/2, 
and note also that the polytropic ansatz with k>7/2 leads to steady 
states with infinite mass. Finally, it is generally believed that steady 
states are unstable if the monotonicity condition on (j) is violated suffi- 
ciently strongly. In this sense one can say that the assumptions on Q 
are optimal. 

(d) The function 



with some Eq < 0. Thus the fact that we do not require Q G C^(]0,oo[) 
with Q" > allows for examples where /o has jump discontinuities, and 
these steady states will turn out to be dynamically stable as well. 

We collect some estimates for pj and Uf induced by an element f eJ-'m- 
As in the rest of the paper constants denoted by C are positive, may depend 
on Q and M, and their value may change from line to line. 

Lemma 1 Let n:=k + 3/2 so that l + l/n>6/5. Then for any f E J^m the 
following holds: 



fo{x,v) = ^{E) 




(2.3) 



also satisfies our assumptions and leads to 




(2.4) 
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(a) /eLi+V'=(lR^) with 



J J f+^'^dvdx + j j fdvdx<C. 



(b) p/eLi+V"(iR3) with 



I pY^'^'dx <C 11 f+^/''dvdx J J \v\^fdvdx 



(n—k)/n 



<CEUf)^ 

(c) UfEL^CiR^) with VC//eL2(IR3), the two forms of Ep^t{f) stated above 
are equal, and 



J\VUf\'dx<C\\pf\\l/,<CE^^{f) 



1/2 



The assertions in (b) and (c) remain valid in the limiting case k — 7/2 where 
n — b, of. Remark (a) above. 

Proof. Part (a) is obvious from assumption (Ql). Splitting the u-integral 
according to \v\<R and \v\> R and optimizing in R yields 



f'^'/'dt 



k/n 



\v\'^fdv 



(n—k)/n 



Therefore, the first estimate in (b) follows from Holder's inequality with 
indices n/k and n/{n — k), and part (a) implies the second estimate in (b). 
Since p/ e nLi+^/"(lR^) and l + l/n>6/5 we find by interpolation, 



in the limiting case this follows directly without interpolation. The estimates 
for Uf follow from the generalized Young's inequality, and the equality of the 
two representations for Epot{f) follows by integration by parts after regular- 
izing p/ if necessary. □ 

As an immediate corollary of the lemma above we note that on J-'m the 
total energy Ti is bounded from below in such a way that £^kin — and thus 
certain norms of / and pf — remain bounded along minimizing sequences: 
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Lemma 2 There exists a constant C >0 such that 

nif)>EUf)-CEUf)'^^ fe^M, 

in particular, 

Km : = inf7i > — oo, 

and E\a_n is hounded along minimizing sequences ofTi in Tm- 

The behavior of 7i and C under scahng transformations can be used to 
show that hu is negative and to relate the /^m's for different values of M: 

Lemma 3 (a) LetM>0. Then -oo kHm <0- 

(b) For allM, M>0, 



hjj= (m/m) Km. 



Proof. Given any function /, we define a rescaled function f{x,v) = 
f{ax,bv), where a,b>0. Then 

C{f) = J J Q{f{ax,bv))dvdx = {ab)-^C{f) (2.5) 
i. e. /G J^Af iff f^^M where M:= {ab)~^M. Next 

E]dn{f) = \ ( ( \v\^f{ax,bv)dvdx = a'%'^E]^i^{f), 



1 [ f f f fio.^^bv)f{ay,bw) 



^pot(/) = -2] j j j ' dwdvdydx = a-%-''E^,,{f). 

To prove (a) we fix any / G J^m and let a = b~^ so that / G J-'m as well. Then 

n{f) = b~^E^,^{f) + r i^pot (/) < 

for 6>0 sufficiently large, since £'pot(/)<0. To prove (b) choose a and b 
such that a~^b~^ = a~^b~^, i. e., b = a~'^. Then 

n{f) = a'n{f), (2.6) 

and since a = (M/MY^^ and the mapping J^m Tjj, f ^ f \s one-to-one and 
onto this proves (b). □ 

One should note that both Lemma |^ and Lemma |^ remain valid in the 
limiting case fc = 7/2. 
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3 Existence of minimizers for k<l/2 

It is conceivable that along a minimizing sequence the mass could run off 
to spatial infinity and/or spread uniformly in space. The main problem in 
proving the existence of a minimizer is to show that this does not happen, 
which is done in the next lemma. Combined with a local compactness result 
for the induced fields and a new version of the splitting technique developed 
in our previous papers this will yield the existence of minimizers. 

Lemma 4 Let {fi) gJ-'m be a minimizing sequence ofTi. Then there exist a 
sequence (ai) C IR^ and eo > 0, Ro>0 such that 

Q{fi)dvdx>eo 

for all sufficiently large i G IN. Here we define Br := {s G 1R^| |x| < R]. 
Proof. For R>1 define 



R ,|x|<l/i?, 
Kr{x):={ l/\x\ , l/R<\x\<R, 



, |x| >R, 



and 

Fr{x) := — l{|a;|>ij}(a;), Gr{x) := — - i? l{|^|<i/^}(a;) 
so that we split the kernel 

^ = Kr{x)+Fr{x)+Gr{x), xgW{?. (3.1) 

\x\ 

Here 1a denotes the indicator function of the set A. We split 

/ |Vt/.rdx= / / PMpMdydx = h + h + h (3.2) 
47r J J J \x — y\ 

according to (|3.1| ), where pi: = pf.. Since {pi) is bounded in L^+^/"(lR^) and 
by (Ql) also in L^(IR^), we find from Lemma [I| (b), using the boundedness 
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of the kinetic energy, 

\h\ < -R / / Piix) Pi (y) dx dy < RC snp / pi{x)dx (3.3) 

J J\x-y\<R ydU^Jy+BR 
< R(-+mn+l)c sup [ / pl+'/'^dx 



n/{n+l) 



< r /■ f fl+^/^dvdx 



-|fc/(n+l) 



and 



R 



pi{x)pi{y)dxdy<CR \ 



I/3I < ||pd|i+i/n||p.*G'H|U+i<C||G^J|(„+i)/2<Ci?-(5-")/("+^); 

for the last estimate we used Holder's and Young's inequality. Since (/j) is a 
minimizing sequence we have, for any R>1, 



hM/2>nu^)>-\h\-\h\-\h 

provided i is sufficiently large. Therefore, 

k/{n+l) 



(3.4) 



liminf 

i—>oo 



sup / / 


fl^^^^ dvdx 


_y(m?-'y+BRJ 





: liminf 1/1 1 



> ^^-(n+4)/(n+l) \_h^^l2 _ _ R- 



(5-n)/(n+l) 



(3.5) 



By Lemma ^ (a) the right hand side of this estimate is positive for R suffi- 
ciently large, and the proof is complete. □ 

Lemma 5 Let (pi) C L-*^ nL-'^+-'^/"'(lR^) be bounded with respect to both norms 
and poeL^nL^+^/''{Wi^) with 



Pi^Po weakly in L^+^/"(lR^ 



Then for any R>0, 



Vf/i^ .,^Vf/i^ .0 strongly m L'(IR^). 
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Proof. Take any R' > R. Since by assumption on k we have 1 + 1/nG 
]6/5,5/3[, the mapping 

is compact. Thus the asserted strong convergence holds on Bri. On the 
other hand, 

which is arbitrarily small for R' large. □ 
We are now ready to show the existence of a minimizer of Ti. 

Theorem 1 LetM>0. Let [f]) G J-'m be a minimizing sequence of Ti. Then 
there is a minimizer /qEJ-'m, o, subsequence (still denoted by (fi)), and a 
sequence of translations Tifi{x,v) = fi{x + ai,v) with (aj)cIR^, such that 

n{fo)=mfn=hM 

and Tifi^fo weakly in L^+^/'^'(lR^). For the induced potentials we have 
Vt/r,/, Vt/o strongly m ^^(IR^). 

Remark. Without admitting shifts in x-space the assertion of the theorem 
is wrong: Starting from a given minimizer /o and a sequence of shift vectors 
(oj) gIR'^ the sequence (Tj/o) is minimizing and in JF^, but if |aj| — i>oo this 
minimizing sequence converges weakly to zero, which is not in JF^,/. 
Proof of Theorem |l]. Let (/j) be a minimizing sequence and (aj)clR^ 
such that the assertion of Lemma ^ holds. Since Ti is translation invariant 
(Tj/j) is again a minimizing sequence. By Lemma |I] (a), (Tj/j) is bounded in 
2^i+i/fc^-[j^6^^ Thus there exists a weakly convergent subsequence, denoted by 
(Tj/j) again: 

T./.^/o weakly in L'+^/\M^). 

Clearly, /o>0 a. e. By Lemma 0, (i?kin(7i/i)) is bounded so by Lemma |l], 
(pi) = (pt,/J is bounded in L^+^/"(lR^), and by assumption (Ql) this sequence 
is also bounded in L^(IR^). After extracting a further subsequence 

Pi^Po: = Pfo weakly in L^+^/'^iJB?). 



12 



Also by weak convergence 

^kin(/o) <liminf £;kin(Ti/i) < oo. 

By (Q2) the functional C is convex. Thus by Mazur's Lemma and Fatou's 
Lemma 

C(/o)<limsupC(T,/,) = M, 

in particular, pqEL^{JR^) by (Ql). 

The key step is to show that up to a subsequence we have 

||V?7T,/,-Vf/o||2^0. (3.6) 

For Rq<R we denote Bji^^ ji:={xeM,^\Ro<\x\<R}, and we split Tj/j as 
follows: 

= ^f! + f-+ff- (3.7) 

Due to Lemma ^, Vt/ji+j2 converges strongly in for any fixed R. It thus 
suffices to show that for any e > 0, 

liminf /|Vf/f3prfx<e (3.8) 

for sufficiently large R. By Lemma |1] (b) we only need to show that 

liminf / / Q{ff)dvdx<e (3.9) 

for sufficiently large R. We use the method of splitting to verify (p.9|) . Ac- 
cording to (^.71), 



3\ 



\x — y\ J J \x — y\ 

=: n{fl)+n{f^) +nif!)~h-h, (3.10) 

with obvious definitions for p],pf,pf. The boundedness of \\VUpi^pA II2 implies 
that 

/l<C||Vf/,2||2. 
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Since pf converges weakly in L^+^/''^ to Po-=Po1b_R(, r-, 



|Vf/p2-Vf/p2 112^0, i^oo 



(3.11) 



by Lemma ^. For R > 2Rq we use Holder's inequality to estimate I2 as follows: 

\y\~'pi[y)d'y<^\\pi\\li-,\ 

'Br,, 



l2<2 [ pi{x)dx j \y\ ^Pi{y)dy<C\\pi\\li^(^ 
Jbr^ jbr.^ ' V R 



It is a simple calculus exercise to show that 



r 



'/' + (l-r)^/^<l-^r(l-r), rG[0,l]. 



With Lemma 1^ and obvious definitions of ,Mf this implies that 

n{fl)+nif^)+nif!) > hMi + K,. + hMf 



M 



M / 



+ 



> 



> 



Mi + M: 

M 



2\ 7/3 



+ 



M J 

M j 



h 



M 



h 



M 



^ 7 Ml+Mf Mf 
3 M M 



h 



M 



and thus 

hM-n{TJ,)-C,hMMlMf <il + i^ 



Here R>2Rq are so far arbitrary, and the constants Ci,C2 are independent 
of R and Rq. Now assume ( |3.9| ) were false. Then there exists ei > such that 
for every i? > and i large we have 



Define 



j j Q{ff)dvdx>ei. 
e2:=-Ci/iAfeoei>0 



(3.12) 
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where cq is as in Lemma ^, and increase Ro from that lemma such that 
C2||Vt/j2||2<e2/4. Next choose /?> 2i?o such that C2(i?o/^)^/^ < £2/4. Then 
for i large, 

hM-n{T,fi)+t2 < hM-n{TJ,)~CihMMlMf 

<^e2 + C2||Vf/,2-Vt/,.||2. 

By (|3.11|) this contradicts the fact that (Tj/j) is minimizing. Thus ( p.9| ) holds, 
and ( p. 61) follows. 

Clearly we have H(/o) < limj7i(Tj/j), and it remains to show that C(/o) = 
M. Assume that Mo:=C(/o)<M; Mo>0 since otherwise /o = in contra- 
diction to 7i(/o) < 0. Let 

SO that by (^), foeJ^M. Then by (^), 

?i (/o) = Wo) = 6-'/'/iM < /^M, 
a contradiction; recall that b<l and /im < 0. □ 



4 Properties of minimizers 

The purpose of the present section is to show that the minimizers obtained 
in the previous one are indeed steady states of the Vlasov-Poisson system. 

Theorem 2 Let /qG^m be a minimizer ofTi. Then 
where 

E:=-\v\^ + Uo{x), 

TP r\n JJEfodvdx 
Eq:=\qQ (0), -^0:= ccrMt f \ f a a 
HQ U^jf^d'^dx 

Uq is the potential induced by /q, and 

<P{E):=M{f>0\Q'{f) = E/Xo}, E<Eo. 
In particular, /q is a steady state of the Vlasov-Poisson system. 
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Remark. 

(a) The Euler-Lagrange equation for our constrained minimization problem 
will give us the relation 

XoQ\fo) = Eonf,-\]0,oo[), 

which we want to invert by means of the function (p. Clearly, if Q' is 
strictly increasing then 

4>{E) = {Q')-\E/Xo), E<Eo. 



(b) Under our general assumption on Q the function Q' : [0, oo[^ [Q'{0),oo[ 
is continuous, increasing, and onto. This implies that for every 77 > 
Q'{0) the set is a closed, bounded interval, and there exists an 

at most countable set Vera such that (<5')~H^) consists of one point for 
^^Krit- The function is decreasing with — oo,Eq]) = [0,oo[, and 
for / G [0,oo[ with XoQ'{f) ^ Krit we have 4>{XoQ'{f)) = / as desired. 



1 ,0</<l, 
/,/>! 



(c) In the example given by ( p.3[ 

Q'if) 



which is not one-to-one on [0,cxd[, but the Euler-Lagrange equation can 
be inverted to yield 



Proof of Theorem Let /o and Uq be a pointwise defined representative 
of a minimizer of H in J^m and its induced potential respectively; to derive 
the Euler-Lagrange relation we will argue first on /q"^(]0,oo[) and then on 
the complement. 
For e > small, 



K,:=!^ix,v)eM'\e<foix,v)<^ 



defines a set of positive, finite measure. Let wEL°°(Si^) be compactly sup- 
ported and non- negative outside K^, and define 



-Tw)dvdx 
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for T and a close to zero, r>0, the function fo + alx^ + TW is bounded on 
K^, and non-negative otherwise. Therefore, G is continuously differentiable 
for such r and a, and G{0,0) = M. Since 



d^G{0,0)= JJ^ Q'{fo)dvdx^O, 



there exists by the implicit function theorem a continuously differen- 
tiable function ri— s>cr(r) with cr(0) = 0, defined for r>0 small, such that 
G{cr{T),T) = M. Hence /o + o"(r)l7^^ + rw GJFjv/. Furthermore, 

c}.G(0,0) _ J!Q'ifo)w 

^ ^ 9.G(o,o) //;,^g'(/o)- ^ ■ ^ 

Since (j'((7(r),r) attains its minimum at r = 0, Taylor expansion implies 
0<n{fo + cjir)lK,+rw)-nifo) = r J J E[a'{0)lK, + w]dvdx + o{T) 
for r > small. With (^TTD we get 

J J[-X,Q'{fo)+E]wdvdx>0 (4.2) 

where 



A. 



//i..Q'(/o)' 

By our choice for w this implies that E = X^Q'{fQ) a. e. on and i?> 
XeQ'ifo) otherwise. This shows that Xe = \o does in fact not depend on e. 
Letting e— s>0, we conclude that 

E = XoQ'ifo) a. e. on /o-'(]0,oo[), (4.3) 
E > AoQ'(0)=Eo a. e. on f,-\0). (4.4) 

If we multiply ( ^.3| ) by /o and integrate we obtain the asserted formula for 
Ao, and Aq < as claimed, since 

1 1 Efodvdx = E^Ufo)-2E^otifo)<nifo)<0. 



We need to invert (|4.3| ). Let be the at most countable set of values 
where Q' is not one-to-one, cf. part (a) of the remark above. Since for any 
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constant 77 G IR the set E ^ {rf) has measure zero — for fixed x this is a sphere 
in u-space — we conclude that 

^crit ■.= {{X,V) e ]R'^\E{x,v)/Xo e Krit} 

is a set of measure zero, and on /o~^(]0,oo[) \ S'crit the Euler-Lagrange equation 
( [4.3|) can be inverted to yield 

as claimed, cf. part (a) of the remark above. Together with ( [4.4|) this proves 
that /o is a. e. equal to a function of the particle energy E. □ 

Next we study the regularity, symmetry, and uniqueness of minimizers. 
Let and denote the space of C"^ functions with compact support and 
with bounded derivatives up to order m, respectively. 

Theorem 3 (a) Let /qG^a/ be a minimizer ofTi. Then /q is spherically 
symmetric with respect to some point in x-space. 

(b) If k> 1/2 assume in addition that 

(t){E)<C{-Ef, E^-00, 

where is defined by Q as in Theorem this condition is com- 
patible with the general assumptions on Q. Then UqEC^(JR^) with 
lim|^l_oof^(a;) = and poeCKM^). 

(c) If in particular Q{f) = f + f^'^^/^ ^ />0, with 0<k<7/2 then up to a 
shift in x-space there are at most two minimizers ofTi in Tm- 

Proof. To prove the spherical symmetry of /o we denote by /q the spherically 
symmetric rearrangement of /o with respect to x. The rearrangement does 
not change the kinetic energy, nor the Casimir functional. By Thm. 3.7] 
it can only decrease the potential energy, more precisely. 



\x — y\ J J \x — y 

for almost all f,iuG IRl But since /o already minimizes 7i, /g minimizes Ti 
as well and the potential energy remains unchanged under the rearrangement 
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which imphes that in the above, equahty holds for almost all f,wGlR^. By 
[|l^, Thm. 3.9] this can happen only if fo{x,v) = /q (x + T^,f ) for some possibly 
f -dependent shift vector T^. Since both /q and /q are minimizers they are 
both of the form stated in Theorem ||, so fo{x,v) = 0(-E'o ~ ^["^P ~ ^/o(^)) 
/q ) = 0(-E'q — ||f p — [//• (x)). The exphcit form of Eq now implies that 
Eq = Eq, hence UfQ^x) = Uf*{x + Ty) and the translation is independent 
of V. Hence the minimizer /q is a spatial translation of /q which proves 
the symmetry assertion. In passing we note that the symmetry can also be 



obtained without the rearrangement concept, cf. ||TI 

To prove part (b), consider first the case where k<l/2 i. e., n<2. 
Then pQ^L^Ci with p=l + l/n>3/2. The usual L^-regularity theory and 
Sobolev's embedding theorem implies that 

UoeW^f^{we)(iC{we). 

Moreover, for any > and x G IR^, 

J\x-y\<l/R\X — y\ Jl/R<\x-y\<R J\^-y\>R 



1/g 




where q is the conjugate exponent to p, so g<3. This implies that 

UoeCbiM^), lim Uo{x) = 0. 

This in turn implies that for |x| sufficiently large, E> Eq; note that the latter 
quantity is negative by Theorem ^ By the same theorem, /o and Pq have 
compact support. 

To continue, we note that since /o depends only on the particle energy E 
via the function 0, 

Poix) = h^iUoix)), xeM^ (4.5) 
where _ 

/•oo 

/i0(u): = 47rV2 / (j){E)VE-udE, uGlR; (4.6) 

J u 

note that /?.(/,(«) = for u > Eq. By the general assumptions on Q the function 
/i0 is continuously differentiable. Thus the regularity of Uq implies that po G 
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Cc(IR^), this in turn implies that Uq E Cl(JR^), thus po e C](IR^), and finally 
[/oeC2(lR3). 

Consider now the case that k>l/2. Clearly we are done if we can but 
prove that po is not only in with p=l + l/n, which is now to small for 
the argument above, but in some with p>3/2. To show this, we use a 
bootstrap argument, based on ( |4.5| ). For this to work, we need some control 
on the growth of the function which is the reason for the extra assumption 
on 0. Indeed, under that assumption the following estimate holds: 

h^iu)<Cil + iEo-u)^), u<Eo. 

If we use this estimate on the set where po is large — this set has finite 
measure — and the integrability of po on the complement we find that 

J Po{x)Pdx<C + J{-Uoix))''Pdx. (4.7) 

If we would pick the limiting case n = 5, i. e., po € we would find by 
Young's inequality that UqEL^, and bootstrapping this via ( [4.7|) gives us po G 
^6/5 However, for n<5 this works better: Starting with po = l + l/nwe 

apply Young's inequality to find that Uq lies in L'^ with q = (1/po — 2/3)~^ > 1, 
and substituting this into ( [4.7|) we conclude that po G L^^ with pi = q/n; note 
that by assumption po < 3/2. If pi > 3/2 we are done. If pi = 3/2 we decrease 
Pi slightly — note that po G — so that in the next bootstrap step we find p2 
as large as we wish. If pi < 3/2 we repeat the process. By induction one sees 
that 

3(l + l/n)(n-l) ^ 

Pk = > 1 

^ n'=(n-5) + 2n + 2 

as long as pk-i < 3/2. But since 2 < n < 5 the denominator would eventually 
become negative so that the process must stop after finitely many steps. 

As to part (c) we first observe that up to some shift Uq as a function of 
the radial variable r : = solves the equation 

l-^(r'u;,y = c,{Eo-Uot^'/\ r>0, (4.8) 

with some appropriately defined constant Ck- Here ' denotes the derivative 
with respect to r. The assertion now follows from the scaling properties of 
([4.8|) , and we refer to p, Thm. 3] for the details. □ 
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5 Dynamical stability 



Let /o G J^M be a minimizer as obtained in Theorem |T]. To investigate its 
dynamical stability we note first that 



H{f)-H{fo) = JJ i^^\v\' + Uoyf-fo)dvdx-j-\\\/Uf 



'Vt/oll^ 



--■d{fJo)-—\\VUf-VUo\\l, feJ^M. 

OTT 



(5.1) 



Since C(/)=C(/o), 
rf(/,/o) 



[E{f-h)-\o{Q{f)-Q{h))] dvdx. 



Since Q is convex and the Lagrange multiplier Aq from Theorem ^ is negative, 
the integrand can be estimated from below by 

(E-AogU))(/-/o). 

According to Theorem ^, this quantity is zero on supp/o, while on 1R^\ 
supp/o it equals 

iE~XoQ'mf = iE-Eo)f>0. 

Thus we see that 

d{fJo)>0, feJ^M. 

We are now ready to state our stability result. Note that if we shift a 
minimizer in space we obtain another minimizer. Moreover, we do in general 
not know whether the minimizers are unique up to spatial shifts. This fact 
is reflected in two versions of our stability result. 

Theorem 4 Let A4m G J-'m denote the set of all minimizers ofTi in Tm- 

(a) For every e>0 there is a 6>0 such that for any solution t^ f{t) of 
the Vlasov-Poisson system with /(O) G C^(IR^) H^Fa^, 



inf rf(/(0),/o) + -||Vf/,(o) 

fo&MM L oTT 



'Vf/oll^ 



<6 



implies that 



inf 



^(/W'/o) + ^l|V^/W-Vf//J|^ 



<e, t>0. 
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(b) Suppose that foEM.M is isolated, i. e., 

inf { II V[//„ - Vf/;^, II2 I /o G Mm \ {TVo | a G IR=^}} > 0. 

Then for every e > there is a 6>0 such that for any solution t\—>-f{t) 
of the Vlasov-Poisson system with f{0) e C^(]R^) HJ-'m, 

c^(/(0),/o) + ^||Vt//(o)-Vf/o||^<5 

implies that for every t>0 there exists a shift vector a E IR^ such that 

ci(/(t),TVo) + ^11 Vf//(t) - Vf/T./o 11^ < e. 

Here T°'f{x,v) : = f{x + a,v) for a G IR^. 
Remark. 

(a) By Theorem ^ (c) the assumption of part (b) holds for the polytropes. 

(b) We only showed that (i(/,/o)>0 for fEJ-'M, but one may think of 
this term as a weighted L^-difference of / and /q. For example, if 
QeC\]0,oo[) with 

"«^=n.)5? Q"(/)>0 

where /max > ||/o||oo as would be the case for the polytropes Q{f) = 
f + f^+'^/^ with 1 < A; < 7/2, then by Taylor-expanding Q we find 

'^(/,/o)>^Cq||/-/o||2, feJ^M with /</max; 

observe that the size restriction on / propagates along solutions of the 
Vlasov-Poisson system. 

(c) The restriction f{0)EJ-'M for the perturbed initial data is acceptable 
from a physics point of view: A physical perturbation of a given galaxy, 
say by the gravitational pull of some outside object, would result in 
a perturbed state which is an equimeasurable rearrangement of the 
original state, in particular, the value of C{f) remains unchanged. 
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Proof of Theorem ^. Assume the assertion of part (a) were false. Then 
there exist e > 0, t„ > 0, and /„(0) G C](IR'^) n J^m such that for all n G IN, 



but 



inf 

fo&MM 



inf 

fo&MM 



rf(/n(0),/o) + ^i|Vf//„(o)-Vt/o||^ 



C^(/n(tn),/o) + ^||Vf/;„(,„)-Vf/o||^ 



< 



n 



>e. 



(5.2) 
(5.3) 



By (13) and (O), 



Urn mum =h 



M- 



Since both Ti. and C are conserved along classical solutions as launched by 

/n(0), 

lim H{fn{tn)) = Hm and /„(t„) G Tm, n G IN, 

n^oo 

i. e., {fn{tn)) is a minimizing sequence for H in JF^^. Up to a subsequence we 
may therefore assume by Theorem |I] that there exists a minimizer /o G 
and a sequence (a^) C IR^ such that 



|Vf//„(t„)-Vf/T<-n/J|2^0; 



(5.4) 



note that for any / G J?-m and a G IR'^ 



II Vt/T«/ - Vf//J|2 = II Vf// - VUr-af,, II 2, 

also d{T''fJo)=d{f,T-''fo). Since lim„^„,H(/„(tJ) = /im = H(T""/o) we 
conclude by (|5.4|) and (|5.1|) that 

rf(/„(t„),r'^"/o)^0, n^oo, 

and since T""" J^eM-m we arrive at a contradiction to ( ^.31 ). Thus part (a) 
is established. 

Now assume that /o is an isolated minimizer in J^m-, and define 
5o := ^inf { II Vf//o - Vf//J|2 I /o G A<M \ {TVo I a G 1R=^}} > 0. 

Let e > arbitrary. In order to find the corresponding 5 we can without loss 
of generality assume that e<5o/4. Now choose 5>0 according to part (a), 
without loss of generality 5 < e, and let /(O) G C^(IR^) f\J^M be such that 

fi(/(0),/o) + ^11 Vt//(o) - Vt/oll^ < 5. 
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The function 

h{t,a) := d{f{t),T-fo) + ^\\VUf^t)-VUT^f,\\l 



^v\\f{t)-fo)dvdx+^\\VUf^t)\\l + ^\\VUfJl 



+ J UT-foPf(t)dx 



is continuous, and since the interaction term goes to zero as |a|— >^cxd, uni- 
formly on compact time intervals, inf^gj^a /i(t,a) is also continuous. Now 
assume that there exists t > such that 

inf h{t,a) > e. 

Since at time zero the left hand side is less then e there exists some t* > 
where 

ini h{t\a) = e. (5.5) 
On the other hand, part (a) provides some /g such that 

dUit*),n) + ^ II Vf//(*.) - Vf//. II ^ < e < ^. (5.6) 
By ( |5.5| ) and ( |5.6| ) together with the non- negativity of d, 

and by the definition of 5q there must exist some a * G IR^ such that /* = T"7o- 
But this means that (|5.5| ) contradicts (|5.6|), and the proof of part (b) is 
complete. □ 



6 The case A; = 7/2; the Plummer sphere 

In this section we study the so-called Plummer sphere which corresponds to 
the minimization of 7i on the constraint set 

^m:={/gI^'/'(]R')|/>0, JJf/'dvdx = M, Ekin(/)<oo| 
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i. e., we take Q{f) = P^'^ which means k = l/2 and n = 5. Due to the fact 
that the scahng transformation 



{Sxf){x,v)=X-'f{\~%\v), (6.1) 

leaves each term in both Ti and C invariant this case poses additional diffi- 
culties. 

As we noted at the end of Section 2 the assertion of Lemma ^ remains 
vahd so that there exists a minimizing sequence (/j) of Ti, in Tm- We shall 
follow the steps in Section 3 to conclude the existence of a minimizer. The 
key step is to find the analogue of Lemma ^ in the presence of the scaling 
( |6.1| ) and to deal with compactness issues in the limiting case {pi) C L^/^(1R^), 
cf. Lemma ^. For a function h = h{x,v)>0 and a cut-off parameter > we 
define 

h{x,v) ifl/N<h{x,v)<N, 
otherwise 



Lemma 6 Let (/j) C J-'m be minimizing. Then there exists a sequence (Aj) C 
]0,cx3[ such that up to a subsequence the following holds for Sifi:= S\Ji: 

(a) For any e > there exists some N>0 such that for all sufficiently large 

ielM, 

\\Sifi — (>S'j/j)|7v||9/7 < 

(b) There exist a sequence (ai)clR^ and eo>0, i?o>0 such that for all 
sufficiently large i G IN, 



/ 



{SJ,f"dvdx>e^. 

(c) Let gi{x,v):=TiSifi{x,v):=X~'^fi{X~'^x + ai,Xiv), gi^go weakly in 
L9/^(1R^) and p,:=pg^^po weakly m L^'^{]R^). Then for any R>Q 
and up to a subsequence, Vf/i^^p, ^ Vf/i^^po strongly in L^(IR^). 

Proof. To prove part (a) we wish to employ the results in ||^, so we con- 
sider (/*), the sequence of spherically symmetric rearrangements with re- 
spect to X, which is again minimizing and in J^m- By P, Thm. 2] there 
exists a symmetric minimizer g such that Sif*^g weakly in L^/'^(1R^). 
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Since HSj/^Hg/T = ||/*||9/7 = M = ||5(||9/7 it follows that Sif*^g strongly in 
L9/7(]r6). Note that since Sif* is spherically symmetric and decreasing in x 
and equi-measurable with Sifi we have Sif* = (Sifi)*. Abusing the notation 
we abbreviate gi :=Sifi in the proofs of parts (a) and (b). 

For e>0 we choose A^>0 such that ||5'||l9/7(^^) < e/2 where A^ = {g< 
l/N\/g>N}. Let A^^jv = {gt <l/N\/g*>N}. Then for i sufficiently large, 

\\9i -9i\Nh/7 = \\9i\\LS/T{A,,j^) < \\9i -9\\lS/T{A,,j^) + \\9\\lS/T{A,,n) 
<e/2+|k||L9A(A,,^). 

Up to a subsequence, g* g pointwise a. e., and thus limsupj 
a. e.. Therefore, by Fatou's lemma we get 

limsup ||^||l9/7(a, ^) < ||^||l9/7(^^) < e/2. 
Hence up to a subsequence and for i sufficiently large, 

\\9i-9i\Nh/T<^- 

Now by the equi-measurability of the rearrangements, (|6 
of the lemma. In fact, for any function h>Q and p> 1, 



<1. 



(6.2) 

implies part (a) 



N 



P 



P 



P 



fi{hl 



{h<l/N\/h>N} 



> s}ds 



ih*-h*iM) 



fi{s <h<l/N} + fi{h>max[N,s]} ds 

/i{s <h*<l /N} + fi{h*> max[A^, s] } 
p 



ds 



Taking h = gi = Sifi and recalling that Sif * = (Sifi)* proves part (a) of the 
lemma. 



To prove part (b) we split for A^>0, gi = gi\N + {9i~ 9: 



i\N) 



With the 

bounded sequence {gi\fyf) instead of (/j) we split as in ( p. 21) of Lemma |[ 
Since {gi\N) is bounded in L^r)L°° the induced spatial densities are bounded 
in, say, L^/^ which we use to bound I^; h and I2 are treated as before. Thus 
instead of ( p.5|) we obtain 



sup 



{gif^'^dvdx 



7/12 



> 



sup 



{gimT^'^ dvdx 



1 7/12 



> Ci?-3/2 lhM/2 - CR-^ - CR-^'^ - \\VUg^^ 



||2 

9i\N II2 
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Because of part (a) and Lemma |I] we can choose > such that 
II Vt/g^_g.|jy II2 < — /iM/4. Then we choose R>0 such that the bracket is posi- 
tive, and the proof of part (b) is complete. 

As to part (c) we first show that for any R>0 the set {Vt/i^^pJ? G IN} 
is relatively compact in L^(IR^). To see this note that we can for any e>0 
choose > and R' > R such that for i sufficiently large, 

II Ib^, Vf/i^^^,j^ - VUi^^g^ II2 < e; 

cf. part (a) together with Lemma |1| and the splitting used in the proof of 
Lemma For R' and A^ fixed the set {1^^, Vf/ig^c,.|^ |z G IN} is relatively 
compact in L^(IR^) since {gi\i^} is bounded in L^nL°°(JR^) and thus the set 
of induced densities is bounded, say, in L^/^(1R^). This implies the relative 
compactness stated above. Next we observe that Isp.Pi^'^Bf.Po weakly in 
L6/^(1R^) which implies that that Vf/i^^p, ^ Vf/i^^po weakly in L'^{Wl^). 
Together, this yields the assertion of part (c). □ 

We are now ready to prove the analogue of Theorem [l| for the limiting 
case k = 7 /2: 

Theorem 5 Let M> 0. Let (/,) dTu be a minimizing sequence ofTi. Then 
there is a minimizer fo&J^M, 0, subsequence (still denoted by (fi)), and a 
sequence of translations and scalings: 

TiSifi{x,v) ■.= \i'^fi{X~'^x + ai,\iv) 

with (tti) C IR'^ and Aj > such that 

n{fo)=min=hM 

and TiSifi^ fo weakly in L^/'^(1R^). For the induced potentials we have 
Vf/T,s./.^Vf/o strongly m L^Wi^). 

Proof. We choose (Aj), (cj), eo>0, and -Ro>0 according to Lemma ^ and 
define gi:=TiSifi, which is again a minimizing sequence in J-'m- This se- 
quence is bounded in L^/''(1R^), and by Lemma |T] (b) the induced spatial 
densities pi are bounded in L^/^(1R^) so that up to a subsequence, gi /o 
weakly in L^/'^(1R^), and pi^Po weakly in L^/^(1R^). We now proceed as in 
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the proof of Theorem |1| with (gi) instead of (/«), the only difference being 
that instead of Lemma ^ and |^ we use the corresponding parts of Lemma ^ 
in order to prove the strong converge of the fields ( |3.ti| ). □ 

Next we show the analogues of the assertions of Theorems ^ and |^: 



Theorem 6 Let JqEJ-'m be a minimizer ofTi. Then 



UE/\oy^\E<0, 
\ ,E>0, 



with some constant Aq < 0, in particular, fo is a steady state of the Vlasov- 
Poisson system. Moreover, /o is spherically symmetric with respect to some 
point in x-space, and up to scalings and translations in x, 

Uo{r) = -Co{l+rY'/\ po{r) = ^{l + r')-'/\ r>0, 

where the positive constant cq depends on Xq. 

Proof. The identity for /o follows exactly as in the proof of Theorem 0. The 
spherical symmetry follows as in the proof of Theorem ^. By monotonicity 
lim^^oo^^('^) ^] ~ 00,0] exists, and since Uq G L^(1R'^) this limit must be zero 
so that Uq is a solution of the corresponding Emden-Fowler equation ( |4.8| ) 
with k = 7/2 and -E'o = 0. The uniqueness up to scalings follows as in 
Thm. 3], and the explicit formulas can be checked by direct computation. □ 

Finally, we state the stability theorem for the limiting case k = 7/2: 

Theorem 7 Let fo G J-'m be a minimizer ofTi. Then for every e > there is 
a 5>0 such that for any solution ty-^ f{t) of the Vlasov-Poisson system with 

fio)eClnTM, 

rf(/(0),/o) + ^||Vf//(o)-Vf//J|i.<5 

implies that for every t>0 there exits a shift vector a G IR^ and a scaling 
parameter A > such that 

dif{t),T'^SJo) + ^ II V[/^(i) - VUras.f, II ^ < e, t > 0. 
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The only difference to the proof of Theorem ^ is that one now has to take 
into account not only the spatial shifts, but also the scaling transformations 
which arise in Theorem and this is straightforward. The condition /(O) G 
Tm can also be relaxed by a scaling transformation as in p, Thm. 4]. 

Note added in proof. The stability of isotropic steady states is also 
addressed in 

Wan, Y.-H.: Nonlinear stability of spherical systems in galactic dynamics. 
Preprint, 2000 
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